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(54) me: DISPLAY ARRANCSMEOT AND METHOD 
(£7) Abstract 

Thfi invoAdoD relacss to a iiacidtig device (10) asd a tneihod 
for a seawwy ftgdb ac fc ca the ccaddng device (10). whea a cursor 
(28) hiis or pawcs to boidcn of a gr^hical detail (32. 34. 36, 
40, 42. 44). la an altgmanve embodiment for marking graphical 
details (32, H 36. 40, 44) it is achieved that d» qiraor 
(26) cotnrdlkd the txaciang device (10) ou a display is fned 
wilhm die bordeis of saidiktaib (32, 34. 36, 40, ^ 44), when 
ti)c cursor hits tb& bqxdeiSi tb& tntcfc^s device (10) receiving a 
sensoiy frwtbagh (46). In an embodxment i& tnrifcgi.rftd bow die 
qgs(g,C28) ig T glg«Bftd t ro m te Jucatioiu Ibe invcafclcna prorvldcs 
^'espedaHy cognitive^ tscdh and motoxic advaniages bo die user 
so-called window interfaces with fcey rows (40, 42, 44) and icais 
(34), 
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Display arrangement and method 
Technical field 

The preHsnt inventioii relaies to a traoking device and a mechod for a sensory 
feedback fiDom a cursor stams for a cursor with graphical details being scanned or passed in 
5 connection with a program or comprising it. More specificaJiy the invenrion provides a signal 
to he generated for a sensory feedback generatmg a movement of the Tracking device. 

State of the art 

The user interface in form of a window (Window') as a facility to access special 
program functions in a data program is found xn.aimost every modem interfere- The program 
10 basing on the use of windows comprises also fimction keys in e.gr key rows, screen and 
display ddimiteis and icons, so-called graphic symbols. 

To achieve access to Che fimctions contained in the symbols a cuxsor is controlled by 
means of a tracking device C computer mouse, n:ackbaiU pointer, etc,) over a display unit 
Showing the j^bols, the function of the symbol being produced by e,g. pressii^ a icey with 
15 one or several touches. 

A problem with the control of ifae cursor to effisct ±e jyinbols arises when it is 
difncuii to fix the cursor to the symbol in a distinct way to let the touches have the desired 
efEsct. 

' It is easier to hit e.g. keys situated at the edge of a display than one in its centre. To 
20 hit a kay at the edge the computer mouse is pulled quickly in toe ri^t^drocdon co reach die 
key. It has no hnportance if die computer mouse is pulled too fer. The cursor will anyhow 
stop at the edge. To hit a key situated e.g, in die cennre of the display ftame more 
coordination is however required by a user of the computer mouse lo hit the target, thus, tht 
user must e.g. slow down the trackmg device before the tey is reached to let die cursor land 
25 on the key . This step takes dme and might be difficult ^xA might even give die user stress 
and irritation, 

. . A fimher problem, which is related to the use of tracking devices for said object, 
is that Che user requires a simultaneous feature, i.e. to.e,g. quickly localize die key for the 
memorizing function' in a program without necessarily having to let the eye scan the display 
30 unit. 

In the eurapean patent applicauon EP-Al -0,607.580 a computer mouse with a pm 
is described receiving signals from a host computer unit effecting -the pin which generates 
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sensory signals to a users nngsr cop s.g. when the cursor status is altered. 
The inventiaTi according to said EP-application is, however, not wMiout prdbletm in that a 
finger top mast be kept in contact with the pin. Ergonoraetric smdiss have shown that the 
user of a computer mou^ when continuously using the computer mouse hardly can keqp the 
5 finger tops over the same spot a longer period of mne. This is easily understood by 
onSnaiy people as some users are easily seized with cramp, writing cramps Being a well 
known complaint, Furthermore, some people suffer from-a lighter or heavier tranbiing. Thus 
the coitqsuter mouse with a pin is restricted in its use for a nor negligible pan of the users 
*^ of nractog devices. 

10 Summary of the invention 

The presem invention intends co solve above mentioned probiems related to a window 
^ inisrfece^and similar in a new and innovanve manner. 

To achieve said object of the invencion it is for marking" graphical details in 
connection wii or comprised in the program proposed a tracking device as a xiser interface 
15 for the access of program functions comprised m tiie details. 

A cursor as t nacidng device controliing on a display receives a sensory feedback 
from starus ^j g r ^^g for auser of the cursor in ahostnnit, wisen the cursor hits or passes said 
graphical details, in such a way that means arranged in the tracking device generate a 
movement of the traddng device.' 
20 The movemeni of the tracidng device consists of that it vibmes, bounces, bun^JS or 

slantSi 

^V^' The cursor might be fixed within the. limits of oprionai details, even three- 

dimensional ones, wiienthe cursor hits the limit or passes it and the cursor is thus released 
by pushing die tracking device mantle downwards. 

h-^ 25 A grapiiical detail might be an icon, a key, a window or a border limiting th5 

window. 

AlCTiarively, graphical details in form of key rows provide various sensory feedback 
dqjending on the key and its funcdon. 

in a further alternative the cursor bemg fixed within a detail, is free to x^iove within the 
30 botders of the detail. 

The cursor, being fixed vwthin a three-dimensional object or detail, is possibly free 
to move within the volume of the object or the detail in an embodiment with the cursor 
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possibly gMcraiirg a shadow within the object or the detail whfm drawn ouc of ihese without 
first having teen released. The shadow allows that the cursor can be naoved more easily into 
the object or the decaiL The iirveniion comprises even a mediod for marking |iapfaica! details 
by means of a trackmg device. 

Brief d^cription of the drawing 
The invention will be descrtbed here below more in detail with reference to the 
attached figures of die diawingE, where 

Figure X schematically illustrates a tracking device in fonn of a computer mouse 
connected to a host computer unit with a display showmg graphical details and a sensoiy 
feedback to the computer mouse accordmg to the invemion. 

Figure 2 schemaucally illustrates an aiwnau ve sensory feedbackin a tracking device 
accordii^ ro figure 1, 

Figure 3 schematically illustrates a pressing of the tracking device according to 
figure 1 in sxi embodiment of the invennon. 

Figure 4 schematically Uiusiratcs in an exploded view of die con^suter mouse an em- 
bodiment of how a means might be arranged in the computer mouse to achieve a movement 
of the computer mouse, 

Figure 5 schematically illuscrateE how a cursor widi a shadow is shown, when the 
user of the cursor touches a tracking device in a three-dimensional environment according to 
an emhodimeni; of xb& invention. 

Detailed descxiptian of preferred embodiments 
The present invention is here describeci more m detail with alternative embodiments 
Ilhistrating the technology of the invention and the cogninve, tactile and motoric advant^s 
provided by a tracking device according to the invention. 

Figure 1 illustrates schematically a computer mouse 10 connected to a host unit 12 
in form of a- compuier, here a PC, with a display unit 14 and a key board 16, 

The present invention vwth its embodiments speciScally describes a computer motise 
10, the invention is however generally applicable to a majority of already known tracking 
devices such as track balls for portable coraputsrs, pointers, etc. 

The computer mouse 10 consists of a casing 20 movable in relation to a bottom 
ponion 18 and the conventional function keys 22, 24. Furthermore, the computer mouse is 
connected to a host unit 12. 14, 16 by means of a signal cable 26 comprising signal lines for 



^097/31333 PCT/5E97yD(tt93 

4 . 

a iradc balls, hert not shown, transminsn in the x and y-direction. Furthernxc«, the signal 

cable comprises lines for iransmittmg sxams signals for ihe cursor 28 from a cursor controller 

comprised in flie host unit 12, . 14. 

The display 14 shows scheinaiically in its frame 30 how the interfecs: might be in a 
5 window environnienL The frame 30 besides the display cursor 28 a window 32, an icon 34, 

a display border 36, a line of three keys 40, 42, 44 and three areas with special attribmes jiot 

to be described in detail. 

When the cursor 28 by means of die computer mouse 10 is moved rcjwanis or over 

the periphery 32, 34, 36, 40, 42, 44 of a gn5)hical detail the host unit 12. 14 in one 
10 embodiment of die. invention gensraies by means of the cursor controllers status (x- and y- 

coorduHies, status flags, etc.) for tbe cursor 28 a sensory feedhackJniorm of a signal 1^ 
, means of signal lines in die cable 26. The signal provides that a means arranged in the 

computer mouse 10 generates a movement of the computer mouse 10. e.g. in a form that the 

computer mouse vibrates, bounces, bumpSt slants, etc* 
15 In an alternative embodiment even the cursor 28 is fixed within the borders, but 

preferably in such a way, djat it is free to move between the borders, e,g. between the 

borders 32 and 34 for the window and the icon, respectively, if ic is fixed witiiin the window. 
In fixing die cursor 2S within a graphical detail the status register for the cursor 28 

is initiatsd that a signal is sent to the computer mouse 10 with its casing 20 receiving a 
20 sensory feedback in that the cursor 28 has been fixsd within or to a graphical detail 32, 34, 

36» 40, 42, 44. In the present embodimeni the casing 20 vibrates 46 in relation co the bottom 

portion 18, The complete computer mouse might evenmaUy vibrate in an embodiment without 

aivy specific casing arid specific bottom portion. A tracking device 10 might insrsfld of 

vibrating bounce or bump each time ths cursor is moved towards or fixed onto a. graplncal 
25 detail. 

The vibradons can be achieved by means of devices such as electroraagnsis* 
piezoelectric transmitters, composite metals and other devices available in the markei: possibly 
achieving vibrarions. 

Furthermore, the graphical detail, in which the cursor 28 has been fixed, might in 
30 another embodiment be identified by means of the vibration frequency, In mots cases it is 
quits sufficient that a few graphical details are to he identified by means of die vibration 
frequency, c-g, by means of an enter key, here designates 40, so that a simultaneous effect 
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is achieved in that e.g. a program or a data file has to be enrered. This is achieved 
Without. the user necessarily sweeping or driftii^ with iiis eyes over the name 30 to finjl the 
enter tey 40, In principle most graphical details might, however, be provided with a specific 
code by means of the vibrauon frequency. 

5 The cursor 28 being fixed within a feame it must be possibly releiased from this 

fixation. According to an embodiment of the present invenoon this is achieved in that the 
computer mouse 10 or any other used tracking device is exerted to a pressure downwards 
effecting a signal transmitter, e.g. a. pressure transmitter, to change the status of the cursor 
28» the user then feeling as if it presses out the cursor or is diving under the edge of die 

10 border, thus improving tfas percepdon of the process on die frame 30. 

In feeling that the cursor is slidmg over e.g. a key 40 the picmre of the key 40 is elucidated^ 
W in a similar way the picture of a window 32 is intensified. 

A parallel to the present invention is the introducuon of stiadows in grapiiical 
interfaces. In that the user can see the shadow of an hiterfece. such as a window* it becomes 

15 much easier to understand the connepi. with several layers in. windows, i.e. windows 
overlapping each otiier. This provides a dnree-dimensional effect and improves the aeststhic 
aspect and provides even an improvement of the users percq)rion of the interface renxiing it 
mor effective. The presen: invention achieves similar features which provides the parallelism. 
In figuie 2 is shown another embodimenc of a sensory feedback according to &e 

20 invendon. 

Figuie 2 schematically illustraiifis the computer mouse 10, the casing 20 being 
^ movable in relation to the bottom pordon IS, slants to the right in the figure, marked by a 

downwards pointing arrow as a sensory feedback from the status register of the cursor 28. 
The slanting might even be addeved forwards, backwards, to the left, etc. Thus, the 
tr^ 25 corresponding slanting indicates a code. The slanting to the right might e.g. unply the key 
■ for die entering function 40. In the same way, die other slannng positions might indicate the 
code for another graphical detail 32. 34, 35, 40, 42, 44- Rrnharmore, alternating slanting 
posidons for a feedback might indicate further codes, 

Mranss for slanting the computer mouse 10 might consist of elecrromagnecs. relays, 
30 etc. ■ 

To leave a fixation within the limited area of a graphical detail or its periphery it is 
illustrated in figure 3. how the casing of the computer mouse 10 is pressed against the 
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bottom ponion IS. a. pressure transmiicsr e-g. generating a signal to the cursor 28 to isave 
a limiced area, where ii prsvrously had been fixed^ As already menuonsd the computsr mouse 
10, with the casing 20 and die bottom, ponian fotraine together a unit, even by means of a 
conveniem arrangement is provided whh a presstmi tran^^ to achieve signals releasing 

5 the cursor 2S. 

Regarding the arrangemem of meanss adapted to gensiats the sensory feedback in 
a tracidng device it is preferably design precautions for the man of the art, but with referrace 
ID figure 4 an embodixnem is exemplified how the means ntiight be arranged within a ^ 
computer mouse ID* 

10 Figure 4 illusiratss, how an electromagnet 50 by means of screws is arranged in a 

means of attachment 52, here fixed by means of screws in the bottom portion 18 of the ^ 
computer mouse 10. Between the casing 20 and the bonoin portion J S a resilism means 56 
is placed. When the computer mouse 10 receives the sensory feedback signal ibe anchor 58 
of the electromagnet 50 hits the casing 20 generating a movemsnr in the casing 20. The 

15 movenienc transfoims mto a vibration by means of the potential energy stored in rhe resilienc 
means 56. To achieve a coding of the sensory feedback as described above already known 
meanss generating pulse sequences might be used. 

Moreover, the present invention solves the problems coimectsd to -the sensory 
feedback by means of a -pm as described in EP-Al-0-607.580 in that the mouse itself vibrates 

20 TTtffV-iTig ii easier for the user with a tendency to be seized with cramp and trembling to use ^ 
the computer mouse 10. They do not necessarily have to touch the computer mouse with any ^ 
specific position of the hand as the whole computer mouse according to the invention, is 
maviiig. 

Figure 5 illuscrares how a cursor with a shadow is shown, when according to one 
25 embodimeni of the present invention a user of the cursor touches a tracking device in a 
three-dimensional virtual surrounding 60, e.g. a space. 

The tracking device 10 is moved to a desired vinual object 52 in form of a three- 
dimensional volume without the object being visible in space. |iowever. the cursor 28 
. controlled by the pointer might be followed on a display means delimited by means of the 
30 solid line 64. The display means is not necessarily a computer screen 30 bui:.may consist of 
any other form' of picrurs reproduction means, e.g. a mirror. 

Tb$ obiect 62 is visible to a user on the display means delimiced by the line 64 in 
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figure 5, i.e. not virtually as the surroundings 60. 

Moreover, the cursor 2& has a shadow 66 on ths display means 64 rsmaining whhm 
the object, when the cursor is pulled out of the object, if the tracking device is not released 
by means of e.g. a pressing downwards. A user of the tracking device finds in some way 
5 easier back to the object 62 in the viimal surroundings after e.g. a pause or another exit fnm 
the space of the object 62. The cursor is then inEcgrated with the shadow when it is sxtuared 
in [he object 62. 

The facts mentioned above are e,g. applicable in CAD programs such as ALIAS* ia, 
being used in the car industry to design products, where it is a problem to decide, where in 
10 the space depth the cursor 28 is situated. It should also be observed that the vimial space 60 
may comprise numbers of space objects 62 m various geometric fotms* tiie useftthiess of the 
siiadow 66 becoming obvious. 

The depth of a space object 62 is e.g, defined by means of a coordinate system 68 
in three dimensions, such as a canesian or a polar system* etc. 
15 Anoiher possible appiication area for the embodiment above of the ciarsor 28 with 

a^dow 56 is in surgery fields e^g. for training of surgical candidates or for more advanced 
surgery of more or less con^Iicatsd operations. 

A ihrc»^dimensional pictm:>B or a picture in perspective consists conventionally of 
a program providing mesh models of objects 62 without any space therein. The space might 
20 be calculated in real time when a surface is passed in the object 52. Thus* a surface in the 
object 62 is defined by means of here not shown polygons tendered in real time, the 
necessary surface to obtain space thus being obrained. 

The present invention has been described with preferred embodiments not to be 
considered to limit the invention. It is die defmition. of the claims that d e fin es the in v e nrion 
25 for the man of an. 
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1. A tracking dflvicc for marking grapixica] deaiis C32, 34, 36, 40, 42, 44) in 
conna:tion with or comprised in a program as an interface for the access of. program 
fimctians cocapiised in the derails, eharactergeed in cfaat a cursor (28) controlled by means 

5 of liie cracking device (10) on a display receives a ^nsory feedback from stams signals for 
a cursor control in a host unit (12, 14, 30), when the cursor hits or passes said graphical 
derails (32, 34, 36, 40, 42, 44)" in such a form that means (50) provided in die tracking 
device (10) generate a movement (46) of the tracking device (10)v where a cursor C28) being 
fixed in a detail can freely move within the borders of ifae detail (32, 34, 36, 40, 42. 44), 

10 2- A crackmg device according to claim 1, eharacAerized in that ifae movement of 

the tracking device consists of that it vibrates, bounces, bomps or slants. 

3, A tracking device according to claim 1 to 1, diaracterized in that fte cmsor can 
be fixed wiihin the borders of optional decaiis (32, 34, 36, 40, 42, 44). when the cursor (2S) 
hies the borders or passes them and when the cursor is released during a pressing-down of 

15 the casing (20) of the tracking device. 

4, A tracking device according to claim 1 to 3, charattrtgrizefl in that a graphical 
detail can consist of an icon (34), a key (40, 42, 44), a window (32) or an edge (3^ 
delimitmg the ftame (30). 

5, A tracking device according to claim 1 to 4, ghflracterized in that graphical 
20 details in form of key rows are Tcxidering different sensory feedbacks depe nd in g on the key 

ami its function. 

^'■^ 6- A nracking device according to claim 1 to 5, characterized in ±ar the cursor (28) 

beii^ fixed in a three-dnnsnsional object or detail is fines to move within the volume of tiK 
object or the detail, 

25 7. A tracking device according to claim 3 to 5, pharamrized in Thar the cursor (2S) 

provides a shadow within tiie object or the detail if drawn out of these without first being 
released. 

8. A trackmg device according to claim 7, eharaeterizedJin tr. i the shadow allows 
the cursor to be moved more easily into the object or the detail. 
30 9. A method for marking graphical details (32, 34, 36. 40. 42. 44) in coxuiecdon 

with or comprised in a program as an user mtsrface for the access of program functions 
comprised in the details, characterized in that a cursor (28) controlled by means of che 
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tracking device (10) on a display receives a sensory feedback from scams signals for a cursor 
control in a.host imii (12* 14, 30) wbsn ths cursor hits or passes said graphical details (32, 
34, 36, 40, 42. 44) in such a form that means (50) provided in the tracking device (10) 
gCTsraie a movement (46) of tte madang device (1G)» where a cursor (28) being fixed in a 
5 detail can neely move within the bonders of the detail (32, 34, 36, 40, 42, 44). 

10. A method accotding lo claim 9, charagterized io that the moveinent of die 
tracking device consists of that it vibrates, bounces, bumps or slants ► 

11. A method according to dahn 9 to 10, characterized in that die cursor can be 
^ fixed widiin the borders of optional details (32, 34, 36, 40» 42- 44), when the cursor (28) hiis 

10 ftte boiticrs or passes them and wiien die cursor is teteased during a pressing-down of the 
casing (20) of die tracking device, 
^ 12, A method according to claim 9 to I L characterize d in tiaat a graphical detail 

can consist of an icon (34) / a key (40, 42, 44-) » a window (32) or an edge (36) deiimidng the 
irame (30). 

15 13. A method according to claim 9 to 12, rJigr^fitgrized in that graphical details m 

ftjim of key rows are rendering differem sensory feedbacks depending on the key and its 

ftmCQOXL 

14. A method according to claim 9 to 13, gharacteriged in diat the cursor <2S) bdng 
fixed in a tfaiee-dhnensional object or detail is free to move within, the volume of the object 

20 or the detail. 

15. A method according to claim 9 to 14, rVtararrgrizfed in ihai the cursor (28) 
^ provides a shadow within the object or the detail if drawn out of diese widiout first being 

releasKl. 

16. A medaod -according to. claim 15, characterized Jn thai the shadow alk3ws4he, 
25 cursor to be moved more easily into the object or the detail. 
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